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This study focused on potential pedagological uses of 
standardized placement exams. A sample of 250 exams of the May 1984 
Biology Advanced Placement (AP) exam was obtained and student 
responses to the question on cell structure were analyzed. The 
frequency of particular responses to the question is listed and 
trends and patterns in the responses are discussed. Interviews were 
also conducted with AP biology instructors, high school science 
coordinators, readers of the 1985 AP Biology exam, college biology 
instructors, and professional research cell biologists for purposes 
of explaining the AP cell structure question results. Textbooks and 
resource materials were then examined for their impact on potential 
learnings of students and for the amount of information that they had 
on cell structures. Recommendations resulting from this study 
include: (1) provisions for additional uses of national standardized 
exam results other than the measurement of achievement; (2) 
development of hierarchically related science textbooks from high 
school to college; and (3) periodic replacement of learning resource 
materials to accompany test materials. (ML) 
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Li- Standardized placemanl exams serve the obvious role of determining the extent of learning by 

the students who take these exams. A careful review of these exams can provide extremely 
important additional data on what, how, and why students learn. The purpose of this paper is to draw 
attention to the further pedagological use of standardized placement exams. 

A nationally drawn group of 20,000 high school students took the Biology Advanced Placement 
(AP) exam May, 1984. The author served as a reader of the Biology essay section of that Advanced 
Placement Exam. Of these students, 86^ answered the following question: 

Describe the structure of a generalized eukaryotic plant cell. Indicate the weys in 
which a nonphotosynthetic prokaryotic cell would differ in structure from this 
generalized eukaryotic plant cell. 
During the course of the reading of the essay question above, trends and patterns in the students' 
responses became apparent. After the June reading, the author requited a randoir^ sampling of the 
exams. College Board/Educational Testing Service made 250 exams available to the author for 
in-depth analysis. (The students' names and schools remained confidential.) Appreciation is 
extended to Dr. Harlan Hanson of College Board and Dr. Carl Haag of Educational Testing Service for 
making possible this analysis. ^ A report of the detailed analysis of the question sample will appear 
elsewhere.' 

The College Board is the organization that is responsible for the AP program; the Educational 
Testing Service provides the operational services. The Advanced Placement program allows high 
school students the opportunity to earn college credit for course work taken while in high school. 
The students who take the AP exam usually are enrolled in special high school second-year biology 
classes taught by superior teachers using college level textbooks. Although the AP exam primarily 
serves superior sK»ndary school students, the program is, in effect, providing a model for a 
national curriculum In introductory college biology because students who do well on the standardized 
exam are granted college credit by numerous colleges and universities around the United States. 
(See reference 2 for a listinn ) The national stancterdized Advanced Placement Exam in Biology, 
therefore, can yield a national data base as to the performance of students in introductory college 
biology. 
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The direction of the evaluation of the 250 exam set was sug^ted by the author's initial reading 
and scoring of nearly 1000 essays during the June 1984 reading. For example, an occasional 
student wDuld state that the function of the Golgi apparatus was unknown ; this was true in 1 96 1 , but 
not in 1 984. Some students were relying on definitional phrases that have become trite: "lysosomes 
as 'suicide bags'." Of the AA% of the students indicating that the nucleus of the cell was limited by a 
barrier, only 2255 indicated that the barrier was a nuclear envelope. Based upon the specific nature 
of their answers, it was clear that students were learning; however , the content of the responses was 
not always appropriate. 

A sample of 250 exams was chosen to be statistically representative of the more than 17,000 
students who answered the cell structure question.-' The sample was biased so that no trivial 
responses (no answer at all or blantantly off-beat responses) were included. The scoring 
procedure was quite different from that used for the June reading. The structures and their 
frequency of mention by the students have been listed in Table I. 



TABLE I 

CELL STRUCTURE SURVEY OF THE 1984 AP EXAM IN BIOLOGY 



structure X. 


.lislal 


Structure 


» listed 


nucleus 


87.2 


nuclear envelope 


9.6 


chloroplast 


80.0 


chromatin 


7.6 


cell wall 


77.2 


flagellaor cilia 


7.2 


mitochondria 


63.6 


double membrane mitochondrion 


7.2 


cell membrane 


58.8 


cell plate 


5.2 


chloroplast function 


57.9 


vesicle 


3.2 


cytoplasm 


51.2 


microtubule 


2.8 


rough endoplasmic reticulum 


48.8 


double meinbrane choloroplast 


2.8 


vacuoles 


48.4 


peroxisome 


2.4 


difference prokaryote vs eukaryote 


46.8 


fluid mosaic membrane model 


2.4 


ribosomes 


44.8 


microfilament 


2.0 


membrane bounded nucleus 


44.4 


spindle 


1.6 


mitochondria function 


36.8 


double membrane nucleus 


1.6 


nuclear membrane 


34.8 


nuclear pore 


1.6 


nucleolus 


32.4 


mesosome 


1.6 


lysosome 


30.8 


polysome 


<1.0 


chromosome 


23.6 


plasmadesmata 


<1.0 


prokaryote Identification 


22.8 


desmosomes 


<1.0 


phospholipid bilayer membrane model 


21.6 


tonoplast 


<1.0 


smooth endoplasmic reticulum 


16.4 


glyoxysome 


<1.0 


centriole 


10.4 


cyloskeleton 


<1.0 




2^ 
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The open-endedness of the essay question was a distinct ads^antage for this type of survey. Only 
two directional clues with reference to structure were In the question: 1) photosynthetic - 
chloroplast and 2) prokaryotic - lack of Internal membranes. In any group of exams one can 
anticipate confusion by a few students, e.g. , switching prokai'yotes for eukaryotes. Over 1 5SS of the 
students turned prokaryotes into animal cells. Lysosomes were placed by 31 ^ of the students in 
plant cells. Ten percent of the students placed centrioles in plant cells with no qualifications. 
Twenty percent of the exams made no mention of plastlds In a structural question that specifically 
Introduces the term photosynthesis. Although they are serious errors, the author has found these 
errors often on college general biology exams. 

The animal cell orientation of a plant cell ultrastructure question was mj3re pronounced than 
expected. Other aspxts of the students' answers were surprising. Below is a listing of cell 
structural concepts that did not appear with any frequency in the answers, 
o virtually no mention of the cytoskeleton or microtubules 

• no distinguishing between free and bound polysomes 
o virtually no mention of peroxisomes or glyoxysomes 

o more than two-fifths of the students did not refer to the plasmalemma 
Considerable confusion existed in the students' answers referring to the following structural 
concepts. 

• chromosomes seen in the Interphase nucleus 

o treatment of the nuclear envelope as a single membrane 

o the relationship of the cytoplasmic waterway system and compart mental ization 

Many ultrastructural concepts were found to be missing or Inaccurately depicted in the exams 

surveyed. 

Reading the exams was, in some ways, like reviewing the historical development of cell 
ultrastructure. A small percentage of the students accurately represented the cell as It was in the 
landmark issue of Scientific American. September, 1 96 1 ."^ Terms developed in the 1 960s such as 
"powerhouse of the cell", "brain of the cell", and "suicide bag" frequently embellished the structures 
listed. 

In an effort to explain the above results, AP biolog/ Instructors, high school science 
coordinators, r^rs of the 1985 AP Biology exam, college biology Instructors, and professional 
research cell biologists were interviewed. High school teachers and their science coordinators 
consistently pointed to three problematic areas in the context of this AP study: 

• remaining current in rapidly evolving fields, 

9 finding lab exercises that would work in their teaching environment and 
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a Obtaining good reliable textbooks. 

Several studies have shown that textbooks oftcrs represented the curriculum for many science 
cour^.^ A strong correlation between currentness of the content material and the textbook used 
was indicated. In states with state-wide tssxtbook adoption policies, the same text edition may be in 
use for as long as 1 2 years at a time. Further, a survey of 1 47 secondary science teachers in the 
Northside Independent School District of Bexar County, Texa?. revealed that fewer than 205E of these 
science teachers were subscribing to a professional journal that would allow them to remain current 
in science content and pedagogy. 

The teachers of .Advanced Placei biology II courses had superior credentials in contrast to 
the whole population of high school teachers. These AP teachers were distinguished by 

additional hours in science after the buccalaureate, membership in organizations such as the 
National Science Teachers Association, participation in science education workshops and in some 
cases serving as biology instructors at community coU^ night schools. They also expressed the 
same concerns in the three problematic areas mentioned above. 

College biology instructors and rest^rch cell biologists often had little interaction with high 
school teachers. College instructors commented that the students they received from high school had 
differing degrees of science preparedness. Lack of a solid chemistry background was the most 
problematic issue. Medical school cell biologists were predicatably the most removal from the high 
school educational system. The professionals at the top of the educational ladder had little idea of how 
or &fen that the AP Dlology program was providing a c/e facto national curriculum for introductory 
college biolog/ courses. 

The interviews provided no surprising results but they did strongly indicate the direction that 
should be taken to explain the AP cell structure question results. Textbooks and resource materials 
should be carefully examined for their impact on potential learning of the students. Guidance on 
textbook selection and review was provided by the biology textbook issue of Science Books and 
Films.^ Reports by Cho et al. end Rosenthal provided methods for correlating learning potential 
from the texts. ^-^ Ten mainstream biology textbooks, five high school and five college biology 
texts , were selected for analysis. ^"'^ Excerpts of the analysis appears in Table II. A report of the 
detailed analysis of the cell structure text survey will appear elsewhere. ' 

College texts averaged more than twice as many electron micrographs on their pages than the 
high school books. Also, the college cell structure micrographs represented were more often the 
transmission variety than the scanning type. Only one high schrol text in five used the term 
"nuclrar envelope"; all college texts used the term "nuclear envelope". Only one in five AP 
responses that listed a nuclear boundary used the term "nuclear envelope". Thirty-one percent of 
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TABLE 11 

SURVEY OF SELECTED TEXTBOOKS FOR KEY CELL STRUCTURE 

INFORMATION 



Item 


2 


3 


4 


5 


6 


7 


8 


9 


10 


copyright year 


80 


86 


85 


83 


85 


82 


83 


83 






/b rduoceii/DooK 


4.5 


2.3 


2.0 


2.9 


2.1 


2.2 


2.2 


2.6 


3 4 


2 9 


total En in book 


20 


57 


37 


58 


41 


49 


225 


1 19 


189 


161 


EM per 1 00 pages 


2.7 


6.5 


4.7 


7.7 


5.0 


5.2 


19.4 


10.1 


16.0 


13.4 


Nuclear membrane 


+ 




+ 


+ 


+ 


+ 










Nuclear envelope 












+ 










centriole not in 






















plant 


X 


+ 


+ 


+ 


+ 


+ 


+ 


± 


+ 


+ 


microtubules 


+ 


+ 


+ 


+ 


+ 


+ 


+ 


+ 


+ 


+ 


ER - Polysome 






















association diagram 




X 


X 


± 






+ 


+ 


+ 


X 


lysosome not in plant 


X 


0 


0 


± 


+ 


+ 


0 


+ 


+ 


+ 


peroxisome 












+ 


+ 






+ 


glyoxysome 


















+ 


+ 


plasmadesmata 












+ 


+ 


+ 


+ 





*1 = BSCS yellow edition 10 

2 = HBJBI0L0GY'2 

3 = HEATH biology''' 

4 = MERRILL BIOLOGY'S 

5 = OTTO AND TOWLE'^ 



6= ARMS AND CAMP BIOLOGY 2ND EDIT lON^ 
7 = CURTIS BIOLOGY 4TH EDITION' ' 
8= JOHNSON BIOLOGY '3 

9 = PURVES AND ORIANS LIFE: THE SCIENCE OFBIOLOQY'^ 

10 = VILLEE, SOLOMON AND DAVIS BIOLOGY '^ 
cell structure chapter pages divided by the total number of book pages - expressed as a S5 

+ = correct tE = teacher's edition 

± = vague X = wrong 

~ = correct in places and reverts to nuclear membrane in others 
" = discussed, but no distinction where found 
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the student responses placedlysosomes in plant cells, whicK reflected the more vague handling of 
lysosomes in high ahool texts. Peroxisomes, glyoxysomes and plasmadesmata were neither 
mentioned in tha high school texts, nor in the AP exam student responses. The explanation of the lack 
of student listing of microtubules was difficult. All texts described microtubules, yet only 3^ of the 
students listed microtubules on their AP essays. Animal cell bias in \h< -mentation of 
microtubular subjects may account for the lack of student listing of microtubuH-; as a plant 
structural characteristic. In summary, the analysis of the textbooks indicated that the students' 
knowledge more closely reflected the content of high school texts than it did college texts. One should 
be mindful that the timed essay question was rather open-ended and that the stuctents' depth of 
response may have been related to this factor. 

The AP biology instructors brought many teaching resources to the attention of the author. The 
most striking resource was the cell structure transparency set distributed by the American Cancer 
Society (ACS). This widely used teaching set contains the term "nuclear membrane", illustrates 
chromosomes in an interphase nucleus, and shows no free polysomes or microtubules. The 
"lollipop" membrane model was used end ribosomes were depicted as randomly distributed on the 
endoplasmic reticulum surface. Working with the Texas Branch of the ACS, the author is updating 
the cell structure transparency set for ACS distribution in 1 986. 

The AP cell structure survey findings have been brought to the attention of the Education 
Committee of the American Society for Cell Biology (ASCB). TheSociety has 5700 cell biolociists as 
Its members. At the Society's national annual meeting, the Education Committee organized a high 
school interface. The interface involved the local host committee inviting selected local high school 
teachers to meet with the local members of the Society and to attend portions of the annual meeting. 
Local liaisons were estobllshed which provided these teachers with future touchstones for cell 
biology resource information. Selected local high school students were brought to the annual meeting 
to attend a special scientific program and to visit commercial scientific exhibits. Participants at the 
meeting became aware of the Society's interest in high school sluctents and teachers. The Society 
added a contingent of college students from primarily undergraduate schools to the meeting visitation 
schedule at the 1 985 annual meeting. The high school/college interface will be a continuing feature 
of the annual meeting. Additionally, the Society published a synopsis of theAP cell structure survey 
in its quarterly newsletter to the membership. Thus, dissemination of the results of this 
standardized exam can make research cell biologists more aware of how their basic research findings 
are filtering down to high school and undergraduate college levels. 

This report has suggested additional uses of the results of national standardized exams other 
than the measurement of student achievement. Analysis of the 1984 Advanced Placement Biology 
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essay exam gave considerable insight into the cell structure knowledge of a national sampling of 
introductory biology college level students. Although these students used college level texts in their 
AP biology course, much of their terminology reflected "first impression" high school biology text 
descriptive wording. The stud/ emphasized that extreme care must be expended in developing high 
school science texts. After reviewing biology textbooks, it was the author's impression that high 
school and college texts were developed independently of each another. Publishers should consider 
the development of hierarchically related science textbooks, from high school to college. 

Learning resource material often reflected older concepts. The major resson for this was that 
resource material was revised less freqjenily than textbooks. Due to Its cost- influenced longevity, 
resource material can be a significant contributor to the continuation of outdated material in a 
course. Periodic replacement of learning resource materials should accompany the acquisition, of 
text materials. 

Professional societies should develop networks with the educational community at all levels. As 
new directions of thought are developed through basic research, these results must be passed down 
the educational chain in a timely fashion. Professional societies should consider joint ventures with 
organizations such as the National Science Teachers Association. Through this type of 
communication, a science information/education network could be established. 

This case study concludes with a proactive model of action. 
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